51 research outputs found
On Learning the Invisible in Photoacoustic Tomography with Flat Directionally Sensitive Detector
In photoacoustic tomography (PAT) with flat sensor, we routinely encounter
two types of limited data. The first is due to using a finite sensor and is
especially perceptible if the region of interest is large relatively to the
sensor or located farther away from the sensor. In this paper, we focus on the
second type caused by a varying sensitivity of the sensor to the incoming
wavefront direction which can be modelled as binary i.e. by a cone of
sensitivity. Such visibility conditions result, in Fourier domain, in a
restriction of both the image and the data to a bowtie, akin to the one
corresponding to the range of the forward operator. The visible ranges, in
image and data domains, are related by the wavefront direction mapping. We
adapt the wedge restricted Curvelet decomposition, we previously proposed for
the representation of the full PAT data, to separate the visible and invisible
wavefronts in the image. We optimally combine fast approximate operators with
tailored deep neural network architectures into efficient learned
reconstruction methods which perform reconstruction of the visible coefficients
and the invisible coefficients are learned from a training set of similar data.Comment: Submitted to SIAM Journal on Imaging Science
On the Adjoint Operator in Photoacoustic Tomography
Photoacoustic Tomography (PAT) is an emerging biomedical "imaging from
coupled physics" technique, in which the image contrast is due to optical
absorption, but the information is carried to the surface of the tissue as
ultrasound pulses. Many algorithms and formulae for PAT image reconstruction
have been proposed for the case when a complete data set is available. In many
practical imaging scenarios, however, it is not possible to obtain the full
data, or the data may be sub-sampled for faster data acquisition. In such
cases, image reconstruction algorithms that can incorporate prior knowledge to
ameliorate the loss of data are required. Hence, recently there has been an
increased interest in using variational image reconstruction. A crucial
ingredient for the application of these techniques is the adjoint of the PAT
forward operator, which is described in this article from physical, theoretical
and numerical perspectives. First, a simple mathematical derivation of the
adjoint of the PAT forward operator in the continuous framework is presented.
Then, an efficient numerical implementation of the adjoint using a k-space time
domain wave propagation model is described and illustrated in the context of
variational PAT image reconstruction, on both 2D and 3D examples including
inhomogeneous sound speed. The principal advantage of this analytical adjoint
over an algebraic adjoint (obtained by taking the direct adjoint of the
particular numerical forward scheme used) is that it can be implemented using
currently available fast wave propagation solvers.Comment: submitted to "Inverse Problems
Enhancing Compressed Sensing 4D Photoacoustic Tomography by Simultaneous Motion Estimation
A crucial limitation of current high-resolution 3D photoacoustic tomography
(PAT) devices that employ sequential scanning is their long acquisition time.
In previous work, we demonstrated how to use compressed sensing techniques to
improve upon this: images with good spatial resolution and contrast can be
obtained from suitably sub-sampled PAT data acquired by novel acoustic scanning
systems if sparsity-constrained image reconstruction techniques such as total
variation regularization are used. Now, we show how a further increase of image
quality can be achieved for imaging dynamic processes in living tissue (4D
PAT). The key idea is to exploit the additional temporal redundancy of the data
by coupling the previously used spatial image reconstruction models with
sparsity-constrained motion estimation models. While simulated data from a
two-dimensional numerical phantom will be used to illustrate the main
properties of this recently developed
joint-image-reconstruction-and-motion-estimation framework, measured data from
a dynamic experimental phantom will also be used to demonstrate their potential
for challenging, large-scale, real-world, three-dimensional scenarios. The
latter only becomes feasible if a carefully designed combination of tailored
optimization schemes is employed, which we describe and examine in more detail
Learned Interferometric Imaging for the SPIDER Instrument
The Segmented Planar Imaging Detector for Electro-Optical Reconnaissance
(SPIDER) is an optical interferometric imaging device that aims to offer an
alternative to the large space telescope designs of today with reduced size,
weight and power consumption. This is achieved through interferometric imaging.
State-of-the-art methods for reconstructing images from interferometric
measurements adopt proximal optimization techniques, which are computationally
expensive and require handcrafted priors. In this work we present two
data-driven approaches for reconstructing images from measurements made by the
SPIDER instrument. These approaches use deep learning to learn prior
information from training data, increasing the reconstruction quality, and
significantly reducing the computation time required to recover images by
orders of magnitude. Reconstruction time is reduced to
milliseconds, opening up the possibility of real-time imaging with SPIDER for
the first time. Furthermore, we show that these methods can also be applied in
domains where training data is scarce, such as astronomical imaging, by
leveraging transfer learning from domains where plenty of training data are
available.Comment: 21 pages, 14 figure
Approximate k-space models and Deep Learning for fast photoacoustic reconstruction
We present a framework for accelerated iterative reconstructions using a fast
and approximate forward model that is based on k-space methods for
photoacoustic tomography. The approximate model introduces aliasing artefacts
in the gradient information for the iterative reconstruction, but these
artefacts are highly structured and we can train a CNN that can use the
approximate information to perform an iterative reconstruction. We show
feasibility of the method for human in-vivo measurements in a limited-view
geometry. The proposed method is able to produce superior results to total
variation reconstructions with a speed-up of 32 times
Accelerated High-Resolution Photoacoustic Tomography via Compressed Sensing
Current 3D photoacoustic tomography (PAT) systems offer either high image
quality or high frame rates but are not able to deliver high spatial and
temporal resolution simultaneously, which limits their ability to image dynamic
processes in living tissue. A particular example is the planar Fabry-Perot (FP)
scanner, which yields high-resolution images but takes several minutes to
sequentially map the photoacoustic field on the sensor plane, point-by-point.
However, as the spatio-temporal complexity of many absorbing tissue structures
is rather low, the data recorded in such a conventional, regularly sampled
fashion is often highly redundant. We demonstrate that combining variational
image reconstruction methods using spatial sparsity constraints with the
development of novel PAT acquisition systems capable of sub-sampling the
acoustic wave field can dramatically increase the acquisition speed while
maintaining a good spatial resolution: First, we describe and model two general
spatial sub-sampling schemes. Then, we discuss how to implement them using the
FP scanner and demonstrate the potential of these novel compressed sensing PAT
devices through simulated data from a realistic numerical phantom and through
measured data from a dynamic experimental phantom as well as from in-vivo
experiments. Our results show that images with good spatial resolution and
contrast can be obtained from highly sub-sampled PAT data if variational image
reconstruction methods that describe the tissues structures with suitable
sparsity-constraints are used. In particular, we examine the use of total
variation regularization enhanced by Bregman iterations. These novel
reconstruction strategies offer new opportunities to dramatically increase the
acquisition speed of PAT scanners that employ point-by-point sequential
scanning as well as reducing the channel count of parallelized schemes that use
detector arrays.Comment: submitted to "Physics in Medicine and Biology
- …